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Remarks 

The Office Action mailed 8 March 2006 has been received and reviewed. Claims 1 , 4, 
8, 13, 15, 19, 24, 26, 31, 33, 38, and 39 have been amended. No other claims have been 
cancelled or added. Therefore, the pending claims are claims 1, 4-<5 3 8-10, 12-13, 15, 17, 19-21, 
23-24, 26-3 1 , and 33-43. Reconsideration and withdrawal of the rejections are respectfully 
requested in view of the amendments and remarks provided herein. 

The 35 U.S.C. §112. Second Paragraph, Rejection 

The Examiner rejected claims 1, 4, 8, 13, 15, 19, 24, 26, 31, 33, 38, and 39 under 35 
U.S.C. §1 12, second paragraph, as being indefinite for failing to particularly point out and 
distinctly claim the subject matter which Applicants regard as the invention. Specifically, the 
Examiner alleges the term "about" renders the claims indefinite. Although Applicant 
respectfully traverses the rejection, such claims have been amended to remove the term. 
However, it is noted that even though the term is removed, that the percentage previously 
modified by the term is still to be given a reasonable range when the scope of the claim is 
interpreted under the Doctrine of Equivalents by one of ordinary skill in the art and as set forth 
by common law as the amendment to such claims (e.g., removing the term "about") is intended 
to clarify the claim, however, the scope of the claim is intended to be the same after the 
amendment as it was before the amendment 

The 35 U.S.C. SI 03 Rejection 

The Examiner rejected claims 1, 4-6, 8, 12, 13, 15, 17, 19, 23, and 38-43 under 35 U.S.C. 
§ 103(a) as being unpatentable over the combination of Grimson et al ("Using adaptive tracking 
to classify and monitor activities in a site", Proceedings 1998 IEEE Conference on Computer 
Vision and Pattern Recognition, Santa Barbara, CA, 1998, June 23-25, pgs 22-29) (hereinafter 
"Grimson") and Stein ("Tracking from multiple view points: Self-calibration of space and time", 
Computer Vision and Pattern Recognition, 1999, IEEE Computer Society Conference on, 
Volume 1, 23-25 June 1999, pgs 521-527) (hereinafter "Stein"). 
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In rejecting all the pending claims, the Examiner alleges that all the limitations of the 
claims are described in Grimson, except that although "Grimson teaches of tracking multiple 
objects in a 'composite image' created using homography transform matrices" (matrices created 
by tracking moving objects in the video streams), "Grimson does not teach that a homography 
matrix should be created from the non-moving, i.e., static, objects in the video streams. 11 
However, the Examiner alleges that "Stein discloses an improvement to the system disclosed by 
Grimson, by first finding (Sections 1.1 and 3.3) a course homography matrix by tracking moving 
objects just as Grimson discloses" and then because "the initial alignment does not perfectly 
align the ground plane" . . . "Stein then refines the alignment by finding a homography transform 
matrix in using the static features of the video streams." As such, the Examiner alleges "it would 
have been obvious to one having ordinary skill in the art at the time of the invention to use the 
refined homography transform approach disclosed by Stein in the method taught by Grimson. 
The combination would allow for a more accurate alignment of the video streams. Thus more 
accurate information would be obtained from the composite video stream." 

Further, the Examiner attempts to show that overlapping of image streams greater than 
85% is advantageous to the system and/or method. However, the claims pending do not describe 
such a limitation. In fact, the limitation clearly indicates that overlap is less than 85%. Having 
an overlap that is less than 85% is advantageous in that it provides "effective use of the camera's 
available field of use" (see, for example, page 19 of the specification). As such, no further 
remarks are provided with respect to the Examiner's comments on such 85% or greater overlap. 

To establish a prima facie case of obviousness, three basic criteria must be met. First, 
there must be some suggestion or motivation, either in the references themselves or in the 
knowledge generally available to one of ordinary skill in the art, to modify the reference or to 
combine reference teachings. Second, there must be a reasonable expectation of success. 
Finally, the prior art references must teach or suggest all the claim limitations. See M.P.E.P. § 
2143. 

Applicant respectfully traverses the Examiner's rejection and submits that the references 
cited do not teach or suggest all the claim limitations of the pending claims. 
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Each of the independent claims (e.g., 1, 13, 24, 31, and 38) describes the use of a 
plurality of imaging devices to provide image data covering a defined search area. Each field of 
view of each imaging device includes a field of view portion which overlaps with at least one 
other field of view of another imaging device. Further, the claims set forth the selection and 
physical marking of the defined search area with a plurality of non-movable landmark points of 
commonality in field of view portions which overlap (e.g., points selected and physically marked 
on the non-movable ground during installation of the imaging devices as set forth on page 25 of 
the pending application). In certain claims, for example, claims 1 and 13, at least one 
homography transformation matrix is computed using image pixel data corresponding to the 
plurality of physically marked landmark points of commonality in field of view portions which 
overlap; the homography transformation matrix being used to combine the plurality of frames of 
image pixel data into a single image representative of at least a portion of the search area. 

The references cited do not show such selection and physical marking as recited in the 
claims. Further, such references do not show the use of at least one homography transformation 
matrix computed using image pixel data corresponding to the plurality of selected and physically 
marked landmark points to combine the plurality of frames of image pixel data into a single 
image. 

As acknowledged by the Examiner, Grimson does not describe all the limitations of such 
independent claims. For example, as stated by the Examiner, '•Grimson teaches of tracking 
multiple objects in a 'composite image 1 created using homography transform matrices" (e.g., 
matrices created by tracking moving objects in the video streams) and "Grimson does not teach 
that a homography matrix should be created from the non-moving, i.e., static, objects in the 
video streams." 

However, contrary to the Examiner's assertions, Stein does nothing to cure the defects of 
Grimson. Stein does indeed disclose an improvement to the system disclosed by Grimson by 
providing fine alignment of frames aligned in the manner provided by Grimson (e.g., using 
homography transform matrices created by tracking moving objects in the video streams). 
However, Stein does not appear to refine the alignment by finding a homography transform 
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matrix using the static features of the video streams as alleged by the Examiner, and clearly does 
not teach or suggest selecting and physically marking the defined search area with a plurality of 
non-movable landmark points of commonality in field of view portions which overlap (e.g., 
points selected and physically marked on the non-movable ground during installation of the 
imaging devices as set forth on page 25 of the pending application) and/or combining 
the plurality of frames of image pixel data into a single image representative of at least a portion 
of the search area using the image pixel data corresponding to the plurality of physically marked 
landmark points of commonality in field of view portions which overlap as recited, for example, 
in claim 1. 

First, Stein does not select and physically mark the defined search area with a plurality of 
non-movable landmark points of commonality in field of view portions which overlap (e.g., 
points selected and physically marked on the non-movable ground during installation of the 
imaging devices as set forth on page 25 of the pending application). Rather, to perform the fine 
alignment of data such as obtained using the method of Grimson, Stein appears to "search for a 
homography matrix A 2 that minimizes the 'sum difference 1 between image 1 and the warped 
image 2" using a method such as described in Referenced Document [5], M. Irani, B. Rousso, 
and S, Peleg., "Recovery of Ego-Motion Using Image Stabilization" In CVPR, pages 454460, 
Seattle, Washington, June 1994 (attached hereto, and hereinafter "Referenced Document [5]) 
(see, page 524 second column or Section 3.3 of Stein cited by Examiner). As such, no selection 
and physical marking is employed. 

Second, it is clear from Stein and the Referenced Document [5] that the fine alignment is 
quite different than combining the plurality of frames of image pixel data into a single image 
representative of at least a portion of the search area using the image pixel data corresponding to 
the plurality of physically marked landmark points of commonality in field of view portions 
which overlap as recited, for example, in claim 1. Stein indicates in Section 3.3 thereof that 
"robust direct-methods for planar alignment such as [5]° are used to refine the alignment As 
recited in Referenced Document [5], the method used therein "does not rely on 2D motion 
information computed near depth discontinuities, where it is inaccurate, but on motion computed 
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over an entire image." In other words, motion is still used to perform the fine alignment (see 1 
Introduction, second to last paragraph of Referenced Document [5]). 

Section 4 of the Referenced Document [5], entitled "Computing 2D Motion of a Planar 
Surface," describes how the technique for detecting multiple moving planar objects locks onto 
the one planar object and its 2D motion parameters. As further provided in the last three 
numbered paragraphs of Section 4, "2D motion models used in the gradual locking on a planar 
object are listed" as: "Translation" in which the "model is applied to the entire image to get an 
initial motion estimation 11 and "followed by segmentation to obtain a rough estimate of the 
object's location"; "Affine" in which the "model is applied only to the segmented region 
obtained in the translation computation step, to get an affine approximation of the object's 
motion" and in which the "previous segmentation is refined accordingly;" and "A Moving Planar 
Surface" in which the "model is applied to the previously segmented region to further refine the 
2D motion estimation of the planar object, and its segmentation." 

The algorithm is further summarized in the Section 5 Concluding Remarks of the 
Referenced Document [5]. Generally, "first, an image region corresponding to a planar surface 
in the scene is detected, and its 2D motion parameters between successive frames are computed. 
The 2D transformation is then used for image warping, which cancels the rotational component 
of the 3D camera motion for the entire scene, and reduces the problem to pure 3D translation." 

From the description in the Referenced Document [5], the refinement process is quite 
different than combining the plurality of frames of image pixel data into a single image 
representative of at least a portion of the search area using the image pixel data corresponding to 
the plurality of physically marked landmark points of commonality in field of view portions 
which overlap as recited, for example, in claim 1 . No physically marked landmark points are 
used for any computations. In fact, it is clearly stated that the method relies "on motion 
computed over an entire image." Reliance on motion models is quite different than using 
physically marked non-movable landmark points in the search area (e.g., the actual area being 
image such as the ground, parking lot, etc.) to combine the overlapping images. 

The fusion or combining of images in Grimson, and the subsequent refinement in Stein, 
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is completely different than that described in the pending claims. In the pending claims, the 
plurality of frames of image pixel data are combined into a single image representative of at least 
a portion of the search area using a plurality of physically marked non-movable landmark points 
of commonality in field of view portions which overlap (i.e., landmark points physically marked 
in the search area). For example, fusion (e.g., calibration) may employ computing respective 
homography matrices based on the identification of several landmark points physically marked 
on the scene and sampled through a user interface. 

Neither Grimson or Stein show such combining of images using such selected and 
physically marked nou-movable landmark points of commonality in the field of view portions 
which overlap. As such, for at least the above reasons, the pending independent claims 1, 13, 24, 
3 1 , and 38 are not obvious in view of the cited references- 
Further, the remainder of the rejected claims (i.e., claims 4-6, 8-10, 12, 15, 17, 19-21, 23, 
26-30, 33-37, and 39-43) respectively depend on one of the independent claims, either directly or 
indirectly. Therefore, they include the limitations of the respective independent claim upon 
which they depend. As such, these claims are also not obvious over Grimson and Stein for the 
same reasons as provided above. 
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Summary 

It is respectfully submitted that the pending claims are in condition for allowance and 
notification to that effect is respectfully requested. The Examiner is invited to contact 
Applicants' Representatives, at the below-listed telephone number, if it is believed that 
prosecution of this application may be assisted thereby. 



Respectfully submitted By 
Mueting, Raasch & Gebhardt, P.A. 
P.O. Box 581415 
Minneapolis, MN 55458-1415 
Phone: (612)305-1220 
Facsimile: (612)305-1228 
Customer Number 26813 



Date Mark J. Gebhardt 



Reg. No. 35,518 

Direct Dial (612)305-1216 



CERTIFICATE UNDER 37 CFR 61.8 : 

The undersigned hereby certifies that the Transmittal Letter and the papcr(s), as described hereinabove, arc being 
transmitted by facsimile in accordance with 37 CFR §1.6(d) to the Patent and Trademark Office, addressed to Mail 
Stop Amendment, Commissioner for Patents, P.O. Box 1450, Alexandria, VA 22313-1450, 
on this .5 day of V)flA/tv^- 2006, at \6'50 Am . (Central Time). 
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